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ABSTRACT 



A video encoding method and apparatus classifies a video 
signal based on human visual sensitivity and determines a 
reference quantization step size for each classification. To 
determine the quantization step size for a given transmission 
speed in consideration of a video signal distribution 
characteristic, a video encoding apparatus adaptivcly allo- 
cates a target bit number, obtains a final quantization step 
size by adjusting the reference quantization step size, and 
encodes the video signal through utilization of the final 
quantization step size. Thus, the compression effect of an 
input video signal is increased and the picture quality of the 
restored image is improved. 

2 Claims, 3 Drawing Sheets 
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VIDEO ENCODING METHOD AND 
APPARATUS BASED ON HUMAN VISUAL 
SENSITIVITY 

BACKGROUND OF THE INVENTION 5 

The invention relates to a video encoding method and 
apparatus, and more particularly to, a video encoding 
method and apparatus in which quantization step sizes are 
determined and target bits are adaptively allocated, consid- 
ering human visual sensitivity to an input video signal to be 10 
encoded and a distribution characteristics of the input video 
signal. 

Generally, a digital video signal has to be encoded and 
compressed to transmit the digital video signal through 
limited transmission paths, due to the large quantity of 15 
information contained in a digital video signal. Effective 
methods to achieve the maximum decrease in information 
quantity, while maintaining the minimum deterioration of 
picture quality, include a differential pulse-coded modula- 
tion technique which obtains a difference image by utilizing 
motion detection and compensation, and a transform coding 
technique which utilizes a discrete cosine transform (DCT) 
function. Such techniques merely minimize the overlapping 
between the video signals as a prerequisite for efficient 
encoding. In practice, however, the actual compression of 25 
information is carried out through quantization. 
Accordingly, to achieve the maximum compression of infor- 
mation while maintaining the minimum deterioration of the 
restored image, the method to quantize the video signal is 
very important. 

Two factors have to be taken into account for maximally 
compressing a video signal, while maintaining the minimum 
deterioration of picture quality. First, quantization step sizes 
are to be set up by sufficiently reflecting the human visual 3S 
sensitivity to the video signal to be encoded. Namely, from 
the standpoint of human visual sensitivity, it is required that 
the video signal which is imperceptible to the deterioration 
of picture quality be quantized with a large quantization step 
size, so that information is compressed as much as possible, ^ 
while the video signal which is perceptible to the deterio- 
ration of picture quality be quantized with a short quanti- 
zation step size, thus reducing the deterioration of the picture 
quality. Second, the quantization step size should be deter- 
mined so that the number of generated bits resulting from 4J 
encoding adapts to the given transmission speed. 

In an existing encoding method, one frame is generally 
divided into 16x16 macrob locks and quantization step sizes 
are determined for each macroblock. At this time, a degree 
of buffer fullness (in terms of data quantity) is calculated for 50 
satisfying the given transmission speed and a reference 
quantization step size which is proportionate to the buffer 
fullness is obtained. Then, by utilizing a variance value of 
the video signal in the macroblock, the final quantization 
step size for adjusting the reference quantization step size is 55 
determined by a method now in widespread use. 

However, such existing video encoding methods do not 
only sufficiently reflect the human visual sensitivity but also 
cause a large difference between the generated bit quantity 
according to the encoding result and the given transmission 60 
speed, which is undesirable. 

SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is to 
provide a video encoding method for maximally compress- 65 
ing a video signal, while minimizing the deterioration of 
picture quality, in order to solve the above problems. 



Another object of the present invention is to provide the 
most suitable apparatus for realizing the above encoding 
method. 

To achieve the above object, a video encoding method 
according to the present invention comprises the steps of: 
classifying macroblocks and variance values of an input 
video signal for encoding, based on human visual sensitiv- 
ity; determining a reference quantization step size corre- 
sponding to each class of the macroblock classified in the 
classifying step; adaptively allocating a block target bit 
number with respect to all block classifications, considering 
an error between a frame target bit number for a given 
transmission speed and a frame-bit-generation quantity esti- 
mation value, and a bit table; adjusting the reference quan- 
tization step size considering the error obtained in the block 
target bit allocation step; and obtaining a final quantization 
step size by utilizing a buffer occupation quantity, a mac- 
roblock. target bit and the reference quantization step size. 

To attain another object, a video encoding apparatus 
according to the invention comprises: a macroblock classi- 
fication unit for classifying a macroblock into one of a 
plurality of predetermined macroblock classes, based on 
human visual sensitivity to a macroblock for forming an 
input video signal to be encoded; an R Q table for storing a 
reference quantization step size according to the visual 
sensitivity of the classified macroblock; a block variance 
classification unit for classifying a variance value of a block 
into predetermined intervals, in order to predict a quantity of 
generated bits when the video signal of the block is quan- 
tized with the reference quantization step size; a bit table for 
storing experimentally derived information based on a rela- 
tionship between the reference quantization step size and the 
bit generation quantity for each block variance value clas- 
sified by the block variance classification unit; a histogram 
calculator for computing a frequency of accumulated gen- 
eration of each classified block in a frame, with respect to the 
block classification generated from the executed result 
obtained by the macroblock classification unit and block 
variance classification unit; a frame-bit -gene ration quantity 
estimator for estimating a quantity of generated frame bits 
from the bit table and histogram, when all macroblocks of 
the frame are quantized with the reference quantization step 
sizes for each macroblock classification; a target bit alloca- 
tor for allocating a block target bit number with respect to all 
block classifications, considering an error value between a 
frame target bit number for a given transmission speed and 
the frame-bit-generation quantity estimation value calcu- 
lated in the frame-bit-generation quantity estimator, and the 
bit table; an R e adjustment unit for controlling the reference 
quantization step size considering the error value; and a 
controller for obtaining a final quantization step size by 
utilizing a buffer occupation quantity, a macroblock target 
bit, and the reference quantization step size. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above objects and advantages of the present invention 
will become more apparent by describing in detail a pre- 
ferred embodiment thereof with reference to the attached 
drawings in which: 

FIG. 1 is a block diagram of a video encoding apparatus 
according to a preferred embodiment of the present inven- 
tion; 

FIG. 2 is a flow chart diagram for explaining the classi- 
fication of a color signal processed in the macroblock 
classification unit of FIG. 1; and 

FIG. 3 is a flow chart diagram for explaining the classi- 
fication of a luminance signal processed in the macroblock 
classification unit. 
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DETAILED DESCRIPTION OF THE 
INVENTION 

The following is a detailed explanation of the present 
invention, referring to the attached drawings. 

FIG. 1 is a block diagram of a video encoding apparatus 
according to a preferred embodiment of the invention. The 



nance signal classifications, is generated according to Table 
1 below. Here, one of a total of eight macrob locks is selected 
according to each classification result. 



TABLE 1 



color 

class color color 

lumin insensitive sensitive 

ance simple complex simple complex 

class even edge edge complex even edge edge complex 

Mc0l 2 345 6 7 



video encoding apparatus comprises a macroblock classifi- 
cation unit 10, an table 12, a block variance classification 
unit 14, a bit table 16, a histogram calculator 18, a frame- 
bit-generation quantity estimator 20, a target bit allocator 22, 
an R G adjustment unit 24, and a controller 26. 

An operation of the video encoding apparatus based on 
the construction of FIG. 1 will be described below. 

Macroblock classification unit 10 classifies the input 
video signal into sixteen macroblock classes based on 
human visual sensitivity to the video signal existing in the 
macroblock, i.e., based on the color signal characteristic and 
the luminance signal characteristic. 

The classification process according to the color signal 
performed in the macroblock classification unit 10 will be 
described with reference to FIG. 2. Here, the following 
inequation (1) is used to classify color signals which are 
sensitive to human visual sensitivity (e.g., red, magenta and 
flesh tones) in the YUV coordinate scheme, where variables 
Y, U and V represent the pixel magnitude of a luminance 
signal and two chrominance signals, respectively, and Kj 
and K 2 are experimental constants. 

t/-150*X, Jkj^I^^ + I |x(V-12S)2 0) 

Referring to FIG. 2, after initialization (step 210), the 
number (Cno) of pixels (P) in a 16x16 macroblock, whose 
color signal value satisfies the inequation (1), is calculated 
(steps 211-214). If the calculated number Cno is less than a 
threshold value Cth (step 215), the macroblock of the color 
signal is classified as a block which is visually insensitive to 
human perception (step 216). Otherwise, that is, if Cno is 
greater than or equal to Cth (step 215), the macroblock is 
classified as a visually sensitive block (step 217). 

On the other hand, referring to FIG. 3, the classification 
process according to the luminance signal performed in 
macroblock classification unit 10 is described. First, after 
having classified the macroblock into 4x4 sub-blocks, a 
variance value (VAR^^) with respect to the luminance 
signal of each sub-block (S) is calculated. Referring to FIG. 
3, after initialization (step 310), the number (Eno) of sub- 
blocks (S) having a variance value larger than the threshold 
value (Eth) among sixteen sub-blocks is calculated (steps 
3il~314). For calculated numbers Eno less than Ei (wherein 
i-[0~N]), the macroblock classification according to lumi- 
nance signal (WM CLASS ) is made for each of N classes (step 
315). 

For example, a macroblock class Mc, which is capable of 
representing two color signal classifications and four lumi- 



The R Q table 12 stores a reference quantization step size 
20 R Q (for I frame, P frame and B frame) suited to the visual 
sensitivity of the respective macroblock classes classified in 
macroblock classification unit 10. Here, the reference quan- 
tization step size has a value according to macroblock class 
and the frame processing method thereof. An example of the 
2 R Q table is shown in Table 2 below. 



TABLE 2 
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Since the reference quantization step size is a quantization 
step size which is determined considering only the visual 
sensitivity to the video signal, the reference quantization 

4 q step size needs to be adjusted considering the given trans- 
mission speed. For thus, the quantity of bits generated when 
Ihe video signal is quantized using the reference quantiza- 
tion step size is estimated. The block variance classification 
unit 14 is used for predicting a quantity of bits generated 

45 when the video signal of the block is quantized with the 
reference quantization step size. Although the bit generation 
quantity can be approximated by the relationship of the 
quantization step size, the variance value of the video signal 
in the block and the bit generation quantity, an exact 

5 o prediction is difficult due to the non-linear and irregular 
relationship. Accordingly, by dividing the block variance 
value into sixteen sections and investigating the quantization 
step size and the bit generation quantity in each section, an 
exact quantity of the generated bits can be predicted. An 

55 example of a threshold value of each section for dividing the 
block variance value (Bv) into sixteen sections in block 
variance classification unit 14 is shown in Table 3 below. 
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TABLE 3-coolinued o™*- I I fl^MxflWcIBv] B 

Mc-Q Bv~0 

5 (The above Tables 1 and 3 show examples of this (equation, 
for macroblock classification Mc and block variance value 
Bv, respectively.) 

The target bit allocator 22 allocates the block target bit 
with respect to a total of 128 cases of the block classification, 
10 considering an error between a given frame target bit 
0 ^ frame) set °y me transmission speed and the estimated 
frame-bit-generation value (EB i ^ AAffi ) and a bit table. The 
block target bit thus-obtained becomes a value sufficiently 
reflecting the human visual sensitivity, the intra-frame dis- 
, s tribution of the video signal, and the transmission speed. 
Bit table 16 stores experimentally derived information ^ target bits belonging to a macroblock having a 
based on a relationship between reference quantization step macroblock classification Mc and a block variance classifi- 
size and a bit generation quantity in each section of block cation Bv is expressed TB[Mc] [Bv], which is computed by 
variance value (Bv) classified in the block variance classi- the following third equation (3). 
fication unit 14. An example of bit table 16 is shown in Table 2 o 

TABLE 4 on the other hand, when the block target bit of the j-th 

block in the i-th macroblock in the frame is indicated as 
25 TB(i j), by assuming the macroblock classification result of 
the i-th macroblock is Mc and the block variance classifi- 
cation result of the j-th block is Bv, the following fourth 
equation (4) is established. 

30 TB(i,f)-TE{MclBv) (4) 

Here, the macroblock target bit number MTB(i) of the i-th 
macroblock can be expressed as a total sum of the block 
target bits TB(ij) in the macroblock as the following fifth 
35 equation (5). 

6 (5) 

MTBft- 2 TB{if) 

H 

40 The R c adjustment unit 24 adjusts R Q for each macrob- 
lock classification, according to the following sixth equation 
(6), considering an error B^^^ between a frame target bit 
When the macroblock classification (FIG. 2) executed in value TB FFAME and an estimated frame-bit-gcneration quan- 
macroblock classification unit 10 is one of eight classifica- tity EB FJtAM£: (expressed as B £R j toJt "TB FJlAM£ -EB FRAME ). 
lions (the value of Mc is from 0 to 7) and the block variance 45 

classification executed in block variance classification unit /tjjLMc] - HjMc] fi£M0Jt31 ^ Mc ^ ^ 

14 is one of sixteen (the value of Bv is from 0 to 1 5), there «»»JRi«r 

is a total of 128 different block classifications. In histogram Here, R^Mc] indicates the reference quantization step 

calculator 18, a histogram representing the frequency at size, W[Mc] is a weight value according to the polarity of 

which the respective block classifications is generated in the 50 *exror the given macroblock classification Mc, and 

frame is computed. Here, when the histogram calculation bufi U * buffcr ca P acit y- ^ an ad i usted reference quan- 

result is defined as H[Mc] [Bv], H[l][2] means that the tiza £ on ste P *f e * determined. 

. . . k . , j„- „.. The controller 26 computes a buffer occupation quantity 

block classified as Mc=l and Bv=2 occurs H limes in one ... . .. ... 

uiuL-is. cid^iucu da m«. 1 * w*ui» n uiuw iu uuc from ^ W| generall0n quanUt y obtained by encoding all ihe 

ame ' 55 previous macroblocks, and a final quantization step size is 

The frame-bit-generation quantity estimator 20 estimates obtained utilizing the buffer occupation quantity, the mac- 

the total bit generation quantity in one frame, when all roblock lar g ct bit > aod R <?- * e finaJ quantization step 

macroblocks in the frame are quantized with the correspond- *" of lhe m " th macroblock of the frame is F (m) and the 

ing reference quantization step size according to each mac- ffl buff " occupy <j«™ty after havuig encoded until the 

roblock classification. The frame-bit-generation quantity can 6 ° macroblock is B(m-1), the final quantization step 

be obtained from the bit table indicated by B[Mc] [Bv] and W 15 determmcd ^ ,he foUoWin S ™™ h ^ uaUon 

the histogram indicated by H[Mc] [Bv]. Here, if the esti- * 

mated value of the frame-bit-generalion quantity is s(B a7r + s(m- 1)) (7) 

expressed as EB^j^^, the estimated value of the frame- 65 F (A m ) -Rq* — " " ' buff- 

bit-generation quantity is obtained by the following second 
equation (2). 
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RB(i) in the equation (7) indicates a real-bit generation 
quantity owing to the encoding result of the i-th macroblock, 
B lNn indicates a buffer occupation quantity just before 
processing the current frame, and S indicates a constant. io 

An embodiment according to the present invention can be 
applied to the international standard schemes MFEG-1 and 
MPEG-2, the CCITT recommended scheme H.261, etc. 

As described above, in a video encoding method and 
apparatus according to the present invention, a video signal lS 
is classified based on the characteristics of human visual 
sensitivity. That is, a reference quantization step size is 
determined for each macroblock classification while a target 
bit number is adaptively allocated and a final quantization 
step size is obtained by adjusting the reference quantization 
step size. By encoding the video signal through the utiliza- 
tion of the final quantization step size, the compression 
effect of an input video signal is great and the picture quality 
of the restored picture is improved. 

What is claimed is: 

1. A method for encoding a video signal, comprising the 
steps of: 

partitioning frame data of an input video signal into 
macroblocks; determining whether a color signal of 
each macroblock is visually sensitive or not based on 
relative magnitude of YUV components of pixels in 
each macroblock establishing two classes according to 
the determining step and classifying each macroblock 
into one of two classes; 

partitioning each macroblock into sub-blocks, computing 
a variance value for a luminance signal of each sub- 35 
block, counting the number of sub-blocks in one mac- 
roblock which have a variance value larger than a 
predetermined threshold value, establishing N classes 
according to the counted number of sub-blocks and 
classifying each macroblock into one of the N classes; 40 

storing a reference quantization step size assigned to each 
of the 2xN classes in an R Q table; 

establishing predetermined threshold variance values and 
classifying each macroblock into one of M classes 
according to the variance value of each macroblock and 45 
the predetermined threshold variance values; 

storing information on bit number for each of the 2xN 
classes in a bit table, which is experimentally derived 
on the basis of the reference quantization step size; 

determining which of the 2xNxM classes each macrob- 50 
lock in a frame should be assigned to and computing an 
accumulated number of macroblocks classified into 
each class; 

estimating a quantity of generated frame bits according to 
the bit table and the histogram when all macroblocks of 55 
a frame are quantized with the reference quantization 
step sizes for each class; 

allocating a target bit number by a macroblock with 
respect to each of the classified classes, considering an 
error value between a frame target bit numbers given on 
the basis of a transmission speed and the frame-bit- 
generation quantity estimation value, and the bit table; 

adjusting the reference quantization step size considering 
the reference quantization step size in said Rg table and 
said error value; and 



60 



calculating a buffer occupation quantity from an amount 
of bits generated by encoding all previous macroblocks 
before a current macroblock and obtaining a final 
quantization step by u tilizin g the buffer occupation 
quantity, the macroblock target bit number, and the 
adjusted reference quantization step size. 

2. An apparatus for encoding a video signal, comprising: 

a macroblock classification unit including a first classifier 
for partitioning frame data of an input video signal into 
macroblocks; determining whether a color signal of 
each macroblock is visually sensitive or not based on 
the relative magnitude of YUV components of pixels in 
each macroblock; establishing two classes according to 
the determination and classifying each macroblock into 
one of the two classes and a second classifier for 
partitioning each macroblock into sub-blocks, comput- 
ing a variance value for a luminance signal of each 
sub-block, counting the number of sub-blocks in one 
macroblock which have a variance value larger than a 
predetermined threshold variance value, establishing N 
classes according to the counted number of sub -blocks 
and classifying each macroblock into one of the N 
classes to thereby classify each macroblock into one of 
the 2xN classes; 

an R Q table for storing a reference quantization step size 
assigned to each of the 2xN classes; 

a block variance classification unit for establishing pre- 
determined threshold variance values and classifying 
each macroblock into one of M classes according to the 
variance value of each macroblock and the predeter- 
mined threshold variance values; 

a bit table for storing information on bit number for each 
of the 2xN classes, which is experimentally derived on 
the basis of the reference quantization step size; 

a histogram calculator for determining which of the 
2xNxM classes of each macroblock in a frame should 
be assigned to and computing an accumulated number 
of macroblocks classified into each class; 

a frame-bit-generation quantity estimator for estimating a 
quantity of generated frame bits according to the bit 
table and the histogram, when all macroblocks of a 
frame arc quantized with the reference quantization 
step sizes for each class; 

a target bit allocator for allocating a target bit number by 
a macroblock with respect to each of the classified 
classes, considering an error value between a frame 
target bit number given on the basis of a transmission 
speed and the frame-bit-generation quantity estimation 
value, and the bit table; 

a Rg adjustment unit for adjusting the reference quanti- 
zation step size considering the reference quantization 
step size in said R c table and said error value; and 

a controller for obtaining a final quantization step size by 
utilizing a buffer occupation quantity, the macroblock 
target bit number, and the adjusted reference quantiza- 
tion step size, wherein the buffer occupation quantity is 
calculated from an amount of bits generated by encod- 
ing all previous macroblocks before a current macrob- 
lock. 
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